Apparatus, method, and system for presentation of multimedia content including augmented reality content

ABSTRACT

The present disclosure relates to methods, devices, and systems for presentation of multimedia content. In an aspect of the present disclosure, a method includes receiving, at a processor of a mobile device, a plurality of images from a camera, at least one image of the plurality of images including an object. The method also includes displaying a camera video stream based on the plurality of images, displaying three dimensional (3D) augmented reality content in the camera video content, and displaying video content based on the 3D augmented reality content. The video content is associated with the object.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 16/403,975, filed on May 6, 2019 and claims benefit of U.S.Provisional Application No. 62/676,748 filed May 25, 2018, both of whichare incorporated by reference herein in their entirety.

TECHNICAL FIELD

The present disclosure generally relates to a multimedia contentdelivery and presentation, and, but not by way of limitation, tomethods, devices, and systems for delivering or presenting multimediacontent including augmented reality content and video content in acamera video stream.

BACKGROUND OF THE INVENTION

With the proliferation of electronic devices, augmented reality (AR) hasbeen implemented in a variety of contexts. Conventional implementationsof augmented reality (AR) include a live direct or indirect view of aphysical, real-world environment with elements that are augmented bycomputer-generated content, such as a graphic (e.g., an animation) andaudio.

AR functionality is typically implemented using mark-less tracking ormarker-based tracking. An example of marker-less based tracking isdescribed in U.S. Pat. No. 8,797,353 in which an augmented reality (AR)feature is coupled with a physical object and marker-less tracking isused to present the AR feature on the physical object. For example, afirst user captures an image of the physical object, attaches AR contentto a location on the physical object represented in the image and sendsa rich media message (associated with the AR content attached to theimage) to a second user, and transfers the physical object to the seconduser. In some implementations, the first user may also attach a file,such as a text file (e.g., a text message), music file, or otherpersonal message file. Using an AR viewer and the rich media message,the second user can view the physical object and see the AR featureappearing on the physical object. Such distribution of AR content inthis manner is not without several limitations that impact use of the ARfeature. To illustrate, the first user is required to capture an imageof the first object, the first user has to know or have the ability tosend the rich media message to the second user, and the marker-lesstracking if often unreliable, thereby disrupting presentation of the ARfeature.

In marker-based AR, an application (e.g., an AR viewer) is configured torecognize markers present in a real-world environment. In suchimplementations, the application must be programmed to recognize themarkers, such as geospatial markers, 2D markers, or 3D markers. The ARviewer may detect the marker and launch the AR content based onrecognition of the marker. In such systems, a device that includes theAR content is often required to store information for multiple markersand/or a large amounts of data corresponding to AR content for eachmarker.

Presenting AR content, such as 3D AR content in a live video stream canbe challenging because 3D content often requires multiple models orpoint clouds, complex localization and mapping function, and is verydata and computation intensive. AR systems are still in their infancydue the technical complexities of implementing such systems. As ARcontent continues to grow in popularity and use, many challenging aspectof AR functionality will need to be identified and overcome to producefaster and more efficient AR systems.

SUMMARY

The present disclosure describes devices, systems, methods, andcomputer-readable storage media for providing augmented reality contentin a camera video stream. For example, a mobile device having a cameraand a display may display a live video stream captured by the camera andmodify the live video stream with augmented reality content andpre-recorded video content that corresponds to an object, such as apackaged delivered to a user.

In some implementations, devices, systems, methods, andcomputer-readable storage media of the present disclosure enablerequester of an order (for delivery of an object to a recipient) torequest a multimedia message to be made available. The multimediamessage may include augmented reality (AR) content that is provided in alive video stream at a device associated with the recipient. Inaddition, the requester (other entity) may provide video content to beincluded in the multimedia message such that the video content ispresented along with the AR content—e.g., the video content may bepresent with and included in 3D AR content. To illustrate, video contentmay be assigned or attached to an order of an item to be delivered to arecipient. For example, the item may be included in a package having amarker and the package may be delivered to the recipient. Additionally,an identifier that corresponds to the video content and that isassociated with the package is provided to the recipient.

In some implementations, the recipient of the package may utilize amobile device to scan the identifier and send corresponding identifierdata to a server associated with the order. Responsive to the identifierdata, the mobile device may receive one or more content items, such asthe video content, AR content (or an indication of selected AR content),text content, and/or image content. The mobile device (e.g., aprocessor) may initiate an AR viewer that causes the mobile device toprovide at least one live video stream associated with a camera of themobile device. The mobile device may display a target to direct a userto position the mobile device in a predetermined location with respectto a marker coupled to the package. By providing the target (e.g., atemplate) for the marker, a user is able to position the mobile devicein an initial position, orientation, and distance with respect to themarker. In response to detection of the marker, the mobile device mayestablish a coordinate system with respect to the marker and initiate amultimedia message in which the AR content (e.g., 3D AR content) and thevideo content is included in the live video stream from the camera.

In some implementations, the mobile device includes presentation dataassociated with a location (e.g., 3D position information) of the videocontent within the 3D AR content. The presentation data may have aninitial value that is calibrated to the coordinate system establishedbased on detection of the marker. After detection of the marker, themobile device may track one or more characteristics of the marker todetermine a change in position (e.g., distance, rotation, translation)of the mobile device with respect to changes in features of the marker(e.g., size, angle, horizontal and/or vertical position within thedisplay). The mobile device may modify the position data based on thedetermined change in position of the marker and/or the mobile device. Insome implementations, the mobile device may also generate a set ofpredicted presentation data values and select one of the predicted setof values for presentation of the video content. The selected value maybe determined based on one or more inputs, such as motion data from asensor (e.g., an inertial sensor) of the mobile device.

Thus, present disclosure describes systems, devices, and methods forproviding multimedia content that corresponds to an object, such as apackage, delivered to the recipient. In such implementations, asender/requestor of the order is not required to have access to thepackage prior to delivery of the package to the recipient. The mobiledevice associated with the recipient is configured to implement a setrules, such as an AR viewer application, that provided one or moreconditions for establishing a coordinate system with respect to thepackage and/or for dynamically determining video content placement databased on the coordinate system. To illustrate, the video content datamay be determined as a function of marker characteristics and a movementprediction algorithm. Based on the video content placement data, the setof rules are further configured to determine and implement video contentpresentation characteristics (e.g., orientation, translation, size,scale, perspective, etc.) to dynamically adjust the video content forpresentation. Accordingly, the video content may be efficientlypresented with a live video stream such that the video content interactswith the AR content included in the live video stream. The displayedvideo content may further be presented based on movement and placementof at least a portion of the AR content such that occlusion andcollision algorithm further coordinate and/or synchronize movement ofthe mobile device with presentation of the AR content and the videocontent within the live video stream. Thus, the present disclosureadvantageously provides multimedia content by establishing a coordinatesystem in a controlled manner such that the one or more rules may beefficiently applied to dynamically determine adjustments/updates topresentation data associated with the video content and to select thepresentation data based at least on features of marker and/or movementor predicted movement of a mobile device.

In an aspect of the present disclosure, one or more methods comprise:receiving, at a processor of a mobile device, a plurality of images froma camera, at least one image of the plurality of images including anobject; displaying a camera video stream based on the plurality ofimages; displaying three dimensional (3D) augmented reality content inthe camera video stream; and displaying video content based on the 3Daugmented reality content, the video content associated with the object.In some such methods, the object includes a package having one or moreitems, the package delivered to a user associated with the mobiledevice, and presentation of the camera video stream including the 3Daugmented reality content and the video content is associated with amultimedia message.

In some of the foregoing implementations, the one or more methods maycomprise: receiving, at the mobile device, an application; storing theapplication at a memory of the mobile device; and accessing theapplication. Additionally, or alternatively, the one or more methods maycomprise: receiving, at the processor, a first image from the camera,the first image including an identifier associated with the object;detecting the identifier included in the image; and sending, from themobile device to a server, at least a portion of the image including theidentifier or identifier data based on the identifier.

In some of the foregoing implementations, the one or more methodscomprise: receiving, at the mobile device from the server, the videocontent, where the video content corresponds to the identifier and isassociated with a sender of the object, and where the video contentcomprises audio/visual content. Additionally, or alternatively, the oneor more methods may comprise: accessing, by the processor, the camera ofthe mobile device; and initiating, by the processor, a prompt to capturethe image of the identifier, wherein, optionally, the identifier iscoupled to the object. In some such implementations, wherein theidentifier comprises a marker coupled to the object.

In some of the foregoing implementations, the one or more methods maycomprise: receiving, at the processor, a second image from the camera;and detecting, by the processor based on the second image, the object ora marker coupled to the object. Additionally, or alternatively, the oneor more methods may comprise: tracking, by the processor, at least aportion of the marker in the plurality of images; determining positioninformation associated with the marker in one or more images of theplurality of images; and displaying the 3D augmented reality contentwithin the camera video stream based on the position information. Insome such implementations, the one or more methods may also comprise:receiving, by the processor, placement data associated with the 3Daugmented reality content; and determining, by the processor based onthe position information and the placement data indicates, a position ofthe video content in relation to the 3D augmented reality content and/orone or more presentation characteristics of the video content.

In some of the foregoing implementations, the one or more methods maycomprise: receiving text data, image data, or both at the mobile devicefrom the server based on the identifier; displaying the text data, theimage data, or both in the camera video content; and optionally,arranging the text data, the image data, or both based on the 3Daugmented reality content. Additionally, or alternatively, the one ormore methods may comprise sending, from the mobile device, anotification associated with a completion of the 3D augmented realitycontent, the video content, or both. In some such implementations, theone or more methods may also comprise: initiating a prompt to send amessage based on a completion of the 3D augmented reality content, thevideo content, or both; receiving an input to send the message; andsending the message to the server, a device associated with a sender ofthe object, or both.

In some of the foregoing implementations, the one or more methodscomprise: establishing communication with a server; and initiating, viathe server, an order for delivery of an item to a recipient. In somesuch implementations, initiating the order comprises: generating orderrequest information; and communicating the order information to aserver. For example, generating the order request information maycomprise: selecting the item; and selecting an option to deliver amultimedia message to the recipient. In such implementations, selectingthe option to deliver the multimedia message may include: selectingorder 3D augmented reality content; providing order video content;providing a text content; and/or providing an image. Additionally, oralternatively, the one or more methods may comprise: receivingconfirmation of delivery of the item to the recipient; and/or receivinga notification that the multimedia message has been viewed.

In another aspect of the present disclosure, one or more devicesinclude: a processor; and a memory storing one or more instructionsthat, when executed by the processor, cause the processor to: receive aplurality of images from a camera, at least one image of the pluralityof images including an object; display a camera video stream based onthe plurality of images; display three dimensional (3D) augmentedreality content in the camera video stream; and display video contentbased on the 3D augmented reality content, the video content associatedwith the object. In some such implementations, the one or more devicesmay further include: a display coupled to the processor; and/or thecamera coupled to the processor. Additionally, the one or moreinstructions may be included in an application that is stored at thememory, and/or the memory may further be configured to store the 3Daugmented reality content, the video content, or a combination thereof.

In some of the foregoing implementations, the one or more instruction,when executed by the processor, may further cause the processor toinitiate storage at the memory of multimedia content presented via thedisplay, the multimedia content associated with the camera video stream,the 3D augmented reality content, the video content, or a combinationthereof. Additionally, or alternatively, in some of the foregoingimplementations, the one or more devices may include: a networkinterface coupled to the processor, where the network interfacecomprises: a transmitter coupled to the processor, the transmitterconfigured to transmit one or more wireless signals; and/or a receivercoupled to the processor, the receiver configured to receive one or morewireless signals.

Some implementations of the present computer-readable storage mediums(e.g., computer-readable storage devices) store instructions that, whenexecuted by a processor, cause the one or more processors to performoperations comprising: receiving, at a processor of a mobile device, aplurality of images from a camera, at least one image of the pluralityof images including an object; displaying a camera video stream based onthe plurality of images; displaying three dimensional (3D) augmentedreality content in the camera video stream; and displaying video contentbased on the 3D augmented reality content, the video content associatedwith the object.

The foregoing has outlined rather broadly the features and technicaladvantages of the present disclosure in order that the detaileddescription that follows may be better understood. Additional featuresand advantages will be described hereinafter which form the subject ofthe claims. It should be appreciated by those skilled in the art thatthe conception and specific examples disclosed may be readily utilizedas a basis for modifying or designing other structures for carrying outthe same purposes described herein. It should also be realized by thoseskilled in the art that such equivalent constructions do not depart fromthe spirit and scope of the disclosure as set forth in the appendedclaims. The aspects which are characterized herein, both as to itsorganization and method of operation, together with further objects andadvantages will be better understood from the following description whenconsidered in connection with the accompanying figures. It is to beexpressly understood, however, that each of the figures is provided forthe purpose of illustration and description only and is not intended asa definition of the limits of the present disclosure.

BRIEF DESCRIPTION OF THE FIGURES

For a more complete understanding of the present example inventions,reference is now made to the following descriptions taken in conjunctionwith the accompanying figures, in which:

FIG. 1 illustrates an example of a system for providing multimediacontent associated with delivery of a package;

FIG. 2 illustrates an example of an order form associated with providingmultimedia content associated with delivery of a package;

FIG. 3 illustrates an example of a data structure associated withproviding multimedia content associated with delivery of a package;

FIG. 4 illustrates an example of a package and a card associated withproviding multimedia content;

FIG. 5 illustrates an example of displayed frames of multimedia contentassociated with delivery of a package;

FIG. 6 illustrates another example of displayed frames of multimediacontent associated with delivery of a package;

FIG. 7 illustrates an example of a frame of multimedia contentassociated with delivery of a package;

FIG. 8 illustrates another example of a frame of multimedia contentassociated with delivery of a package;

FIGS. 9A, 9B, and 9C illustrate examples of frames of multimedia contentassociated with delivery of a package;

FIG. 10 illustrates another example of displayed frames of multimediacontent associated with delivery of a package;

FIG. 11 illustrates an example of content from a mobile device displayedat an electronic device;

FIG. 12 illustrates a flow diagram of an example of a method ofoperating an electronic device;

FIG. 13 illustrates a flow diagram of an example of a method ofoperating a server; and

FIG. 14 illustrates a flow diagraph of an example of a method ofoperating a mobile device.

DETAILED DESCRIPTION OF THE INVENTION

Particular implementations of the present disclosure are described belowwith reference to the drawings. In the description, common features aredesignated by common reference numbers throughout the drawings. As usedherein, various terminology is for the purpose of describing particularimplementations only and is not intended to be limiting ofimplementations. For example, the singular forms “a,” “an,” and “the”are intended to include the plural forms as well, unless the contextclearly indicates otherwise. It may be further understood that the terms“comprises” and “comprising” may be used interchangeably with “includes”or “including.” Additionally, it will be understood that the term“wherein” may be used interchangeably with “where.”

As used herein, an ordinal term (e.g., “first,” “second,” “third,” etc.)used to modify an element, such as a structure, a component, anoperation, etc., does not by itself indicate any priority or order ofthe element with respect to another element, but rather merelydistinguishes the element from another element having a same name (butfor use of the ordinal term). The term “coupled” is defined asconnected, although not necessarily directly, and not necessarilymechanically; two items that are “coupled” may be unitary with eachother. The phrase “and/or” means and or. To illustrate, A, B, and/or Cincludes: A alone, B alone, C alone, a combination of A and B, acombination of A and C, a combination of B and C, or a combination of A,B, and C. In other words, “and/or” operates as an inclusive or.

Further, a device or system that is configured in a certain way isconfigured in at least that way, but it can also be configured in otherways than those specifically described. The feature or features of oneembodiment may be applied to other embodiments, even though notdescribed or illustrated, unless expressly prohibited by this disclosureor the nature of a described implementation.

Referring to FIG. 1, an example of a system 100 for deliveringmultimedia content associated with delivery of a package is shown.System 100 includes an electronic device 110, a server 130, a mobiledevice 150, and a distribution entity 180, each of which may be coupledvia a network 190. Network 190 may include a wireless network, a wirednetwork, or a combination thereof. For example, network 190 may includeone or more of a local area network (LAN), metropolitan area network(MAN), wide area network (WAN), wireless LAN (WLAN), the Internet,intranet, extranet, cable transmission system, cellular communicationnetwork, and/or the like.

Electronic device 110 may include a network interface 112, one or moreprocessors 114, a memory 116, and a camera 120. Network interface 112may be configured to be communicatively coupled to one or more externaldevices, such as server 130 and/or mobile device 150, via one or morenetworks (e.g., 190). For example, network interface 112 may include atransmitter, a receiver, or a combination thereof (e.g., a transceiver).Memory 116 may store instructions 118, that when executed by the one ormore processors 114, cause the processor(s) 114 to perform operations asdescribed further here. For example, the one or more processors 114 mayperform operations as described with reference to FIG. 12. In someimplementations, memory 116 may store an application (e.g., a softwareprogram) associated with ordering and/or delivery an item. Camera 120may include an image capture device configured to generate image data,such as image data and/or video data. In some implementations,electronic device 110 may include one or more input/output (I/O)devices. The one or more I/O devices may include a mouse, a keyboard, adisplay device, the camera 120, other I/O devices, or a combinationthereof.

Electronic device 110 may include or correspond a communications device,a mobile phone, a cellular phone, a satellite phone, a computer, atablet, a portable computer, a display device, a media player, or adesktop computer. Additionally, or alternatively, the electronic device110 may include a set top box, an entertainment unit, a navigationdevice, a personal digital assistant (PDA), a monitor, a computermonitor, a television, a tuner, a radio, a satellite radio, a musicplayer, a digital music player, a portable music player, a video player,a digital video player, a digital video disc (DVD) player, a portabledigital video player, a satellite, a vehicle, any other device thatincludes a processor or that stores or retrieves data or computerinstructions, or a combination thereof.

Server 130 may include a network interface 132, one or more processors134, and a memory 136. Network interface 132 may be configured to becommunicatively coupled to one or more external devices, such aselectronic device 110, mobile device 150, and/or a device ofdistribution entity 180, via one or more networks (e.g., 190). Forexample, network interface 132 may include a transmitter, a receiver, ora combination thereof (e.g., a transceiver). Memory 136 may storeinstructions 138, preview content 139, order data 140. Instructions 138may be configured to, when executed by the one or more processors 134,cause the processor(s) 134 to perform operations as described furtherhere. For example, the one or more processors 134 may perform operationsas described with reference to FIG. 13. In some implementations, memory136 may store an application (e.g., a software program) associated withordering an item for delivery. Preview content 139 may includepre-determined content for generating a preview of multimedia content(e.g., multimedia message preview 194). To illustrate, preview contentmay include pre-determined video content of a representative package,and augmented reality content and/or video content 193 may be combinedwith preview content 139 to generate multimedia message preview 194. Insome implementations, server 130 may provide multimedia message preview194 to electronic device 110.

The order data 140 may include a data structure, such as a table, thatincludes order information (e.g., 192) for one or more orders. Forexample, each order may be arranged in the order data 140 as an entry142. To illustrate, entry 142 may include at least a portion of orderinformation 192. An illustrative example of order data 140 (e.g., entry142) is described further herein with reference to FIG. 3. Additionally,or alternatively, memory 136 may be configured to additional data, suchas content associated with a multimedia message as described furtherherein. For example, such content may include video content 193, ARcontent, text data, image data, or a combination thereof.

In some implementations, server 130 may comprise a general purposeprocessor-based system (e.g., PC and/or server system having aprocessor, memory, suitable I/O functionality, and OS) operating undercontrol of an instruction set to interface with electronic device 110,mobile device 150, and/or distribution entity 180. In someimplementations, server 130 may include one or more input/output (I/O)devices. The one or more I/O devices may include a mouse, a keyboard, adisplay device, the camera 120, other I/O devices, or a combinationthereof.

Mobile device 150 may include a network interface 152, one or moreprocessors 154, a memory 156, a camera 168, and a display 172. Networkinterface 152 may be configured to be communicatively coupled to one ormore external devices, such as electronic device 110 and/or server 130,via one or more networks (e.g., 190). For example, network interface 152may include a transmitter, a receiver, or a combination thereof (e.g., atransceiver). Memory 136 may store instructions 158 and application 160.Instructions 158 may be configured to, when executed by the one or moreprocessors 154, cause the processor(s) 154 to perform operations asdescribed further here. For example, the one or more processors 154 mayperform operations as described with reference to FIG. 14.

Application 160 (e.g., a software program) may be associated withordering and/or delivering an item. In some implementations, application160 corresponds to an AR viewer and includes one or more sets of rulesto perform operations as described herein for presenting multimediacontent that includes AR content 162 included in a camera video stream(associated with images 170) and in which video content 193 isdynamically presented based on a position of camera 168 and furtherbased on the AR content within the camera video stream. For example, theone or more sets of rules may direct the recipient to position a camerawith respect to package 186 and to establish a coordinate system.Application 160 may include augmented reality (AR) content 162,placement data 163, or both. The placement data 163 may be used forpresenting/positioning video content 193 within AR content 162.Additionally, placement data 163 may be used to modify characteristics,such as size and/or scale, of the video content 193. Camera 168 mayinclude an image capture device configured to generate an image 170(e.g., image data). For example, image 170 may include image data and/orvideo data. In some implementations, electronic device 110 may includeone or more input/output (I/O) devices. The one or more I/O devices mayinclude a mouse, a keyboard, a display device, the camera 120, other I/Odevices, or a combination thereof.

Distribution entity 180 is configured to provide a system by whichorders may be fulfilled and delivered. In some implementations,distribution entity 180 may include or correspond to a provider, anacquirer of goods and/or services, a distributor, and/or a shipper. Forexample, distribution entity 180 may be configured to package one ormore items to be delivered to a recipient, and to initiate and/ordeliver the package. In a particular implementation, server 130corresponds to a provider (e.g., seller) of one or more items anddistribution entity 180 corresponds to a shipping entity that includesand inventory of the one or more items and shipping media (e.g., boxes,envelopes, etc.). In such implementations, distribution entity 180 maydeliver a package including one or more items or may operate with athird party for delivery of the package. Although described as beingseparate from server 130, in other implementations, distribution entitymay include server 130.

Distribution entity 180 may include an electronic terminal 182.Electronic terminal may comprise a general purpose processor-basedsystem (e.g., PC and/or server system having a processor, memory,suitable I/O functionality, and OS) operating under control of aninstruction set to interface with electronic device 110, server 130,and/or mobile device 150. Electronic terminal 182 may include orcorrespond a communications device, a mobile phone, a cellular phone, asatellite phone, a computer, a tablet, a portable computer, a displaydevice, a media player, or a desktop computer. Additionally, oralternatively, the electronic terminal 182 may include a set top box, anentertainment unit, a navigation device, a personal digital assistant(PDA), a monitor, a computer monitor, a television, a tuner, a radio, asatellite radio, a music player, a digital music player, a portablemusic player, a video player, a digital video player, a digital videodisc (DVD) player, a portable digital video player, a satellite, avehicle, any other device that includes

During operation of system 100, electronic device 110 may communicatewith server 130 to initiate an order for delivery of an item. Forexample, electronic device 110 may access an order form as describedwith reference to FIG. 2. In such implementations, electronic device 110may be associated with or correspond to a sender and/or requestor. Insome implementations, the order form may accessible via a web page or anapplication (e.g., 160), such as an application stored at memory 116.The application (e.g., a software component) may be associated with aprovider, distributor, or shipper of the item. Additionally, oralternatively, the application may be associated with a third part thatprovides a platform or interface for the provider, distributor, orshipper. As an illustrative, non-limiting example, the application maybe associated with a business that delivers items, such as flowers, food(e.g., cookies, fruit, etc.), or clothing. In some implementations, theapplication may include a social medial/social networking feature, suchthat the sender/requester can communicate with the recipient via theapplication.

Electronic device 110 may generate order information 192 to initiate theorder. For example, electronic device 110 may generate order information192 to populate the order form. Order information 192 may include anindication of the item to be delivered, sender data (e.g., name,address, phone number, email address, payment information, etc.),recipient information (e.g., name, address, phone number, email address,etc.), a message, or a combination thereof.

Additionally, or alternatively, order information 192 may include orindicate that a multimedia message is to be made available to arecipient of the order. The multimedia message may be associated withmultimedia content that includes AR content and/or video contentincluded in a camera video stream. In such implementations, orderinformation 192 may include video content 193. As used herein, videocontent 193 includes video data (e.g., a plurality of image), or videodata and audio data. In some implementations, the sender/requestor maygenerate video content 193 via electronic device 110 (e.g., 120) as partof filling out the order form. For example, the order form may beconfigured to prompt the sender/requestor to generate or provide thevideo content 193. Although described as having the video contentgenerated and/or provided with the order information 192 from theelectronic device 110, in other implementations, video content 193 maybe generated and or provided by server 130, distribution entity (e.g.,electronic terminal 182), or another device or entity. To illustrate,when server 130 and/or distribution entity 180 correspond to a provider,the provider may include the video content 193 into the orderinformation 192 to be used in a multimedia message. For example, if thesender/request does not request a multimedia message (that includes apersonalized message for the recipient) with the order, the provider,distributor, and/or shipper may provide the video content 193.Additionally, or alternatively, order information 192 may include a timevalue, such as a date, a time, a duration, etc., that corresponds to ordefines a time period during which the multimedia content is available.To illustrate, the time period may start or be based on an order timewhen the order is submitted or a delivery time corresponding to deliveryof a package (e.g., 186) to a receipting, as illustrative, non-limitingexamples. In other implementations, the multimedia content may beavailable for a predetermined time period (e.g., a pre-set time period).

Server 130 may receive the order information 192 and may generate entry142 that corresponds to the order information 192. In someimplementations, the entry 142 may include an order number and/oridentifier (e.g., 187) that is configured to be used as an index toidentify entry 142 within the order data 140. Server 130 may also beconfigured to identify and store video content 193. For example, videocontent 193 may be stored at memory 136 and included in entry 142, atmemory 136 at a location pointed to by entry 142, or at a locationremote from server 130 and identified by (e.g., pointed to) entry 142.Although the order data 140 is described as being stored at server 130,in other implementations, order data 140 may be stored at a remotelocation from server 130, such as at a remote database, at distributionentity 180 (e.g., electronic terminal 182), or at another location.

After receiving order information 192, server 130 may send (e.g., via apush or a pull operation) an order request 195 to distribution entity180 (e.g., electronic terminal 182). The order request 195 may includeat least a portion of the order information 192 and/or at least aportion of entry 142. The distribution entity 180 may process the orderrequest 195 to create a package 186 that includes one or more items.Package 186 may include the item or a shipping media, such as a box, abag, crate, etc. In some implementations, package 186 may include orcorrespond to a package identifier (e.g., a package reference) thatindicates characteristics of the package, such as dimensions, volume,weight restriction, etc. In such implementations, distribution entity180 may communicate the package identifier and/or one or morecharacteristics of package 186 to server 130 and server 130 mayoptionally include such information in entry 142.

The package 186 may include or be coupled to identifier 187, arepresentation of identifier 187, and/or a marker 188. To illustrate,identifier 187 may be represented as a bar code, a QC code, alphanumerictext, or a combination thereof, as illustrative, non-limiting examples.In some implementations, the identifier 187 may include or be the sameas the marker 188. In other implementations, the marker 188 may includean image, a logo, one or more points or features, etc. The identifier187 and/or the marker 188 may printed on the package 186 and/or item,printed on a card or sticker that is coupled to the package and/or item,as illustrative, non-limiting examples. In other implementations, theidentifier 187 may include a digital or graphical representation that iscommunicated to a recipient or to a device (e.g., mobile device 150)associated with the recipient.

Distribution entity 180 may initiate physical delivery of package 186 torecipient. For example, the recipient may receive a delivery includingpackage 186 as described with reference to FIG. 4. Based on delivery ofpackage 186 to recipient, distribution entity 180 (e.g., electronicterminal 182) may send a delivery confirmation 196 to server 130,electronic device 110, and/or another device, such as another deviceassociated with the sender. In some implementations, server 130 mayreceive delivery confirmation 196 and sent a confirmation message (basedon delivery confirmation 196) to a device (e.g., 110) associated withsender.

The recipient may be associate with (e.g., be a user of) mobile device150. Based on receiving package 186, recipient may operate mobile device150 to access application 160. In some implementations, application 160includes an AR viewer. If mobile device 150 does not include application160, mobile device 150 may download application 160, such as from server130. Processor 154 may execute one or more instructions of application160 to perform operations described herein. To illustrate, processor 154may access camera 168 and provide one or more images captured by camera168 via display 172. For example, the one or more images (e.g., 170),such as a live video stream, may be provided to the display 172 and maybe presented in real-time or near real-time. The displayed imagespresented in real-time or near real-time may be referred to as a cameravideo stream.

Processor 154 (e.g., application 160) may provide a prompt to capture animage of identifier 187 and/or marker 188 and/or to enter or select aninput that corresponds to identifier 187. Processor 154 (e.g.,application 160) may detect identifier 187 and determine identifier data197 based on the detected identifier 187. For example, identifier data197 may include a portion of image data. As another example, such aswhen identifier 187 includes a barcode, application may process barcodeto determine a data value (e.g., 198). Mobile device 150 may communicateidentifier data 197 to server 130. Responsive to receiving identifierdata 197 (e.g., identifier 187), server 130 may access entry 142 toidentify video content 193 to be provided to mobile device 150 and maycommunicate the video content to mobile device 150. In someimplementations, server 130 may also communicate other informationand/or data to mobile device 150 based on the received identifier data197. For example, server 130 may communicate text data, image data, ARcontent (or an identifier thereof) to mobile device 150 for use inproviding multimedia content.

After transmission of the identifier data 197, processor 154 (e.g.,application 160) may generate a prompt via display 172 for recipient toposition camera 168 so marker 188 (e.g., package 186) is presented indisplay 172. For example, processor 154 initiate a target within displayas described with reference to FIG. 5. By providing the target (e.g., atemplate) for the marker 188, a user is able to position the mobiledevice 150 in an initial position, orientation, and distance withrespect to the marker 188. The initial positioning of the mobile device150 with respect to marker 188 may be known by the mobile device 150.For example, application 160 may include initial positioning data, suchas dimension of marker 188, a distance between marker 188 and mobiledevice 150, an orientation and/or translation of marker 188 withreference to a coordinate system implementation responsive to markerdetection, etc.

Processor 154 may detect marker 188 and, in response to detection of themarker 188, may implement a coordinate system with respect to the markerand initiate presentation of multimedia content including the AR content162 and video content 193 in at least a portion of the video contentstream. For example, processor 154 may display AR content 162 and videocontent 193 within camera video stream. In some implementations, thevideo content 193 is displayed in relation to and/or on a portion of theAR content. Examples of multimedia content are described herein at leastwith reference to FIGS. 5-10.

In some implementations, mobile device 150 includes presentation data164 associated with a location (e.g., 3D position information) of videocontent 193 within the 3D AR content 162. For example, the presentationdata 164 may indicate or define a perimeter or boundary associated withpresentation of video content 193. The presentation data 164 may have aninitial value that be calibrated to the coordinate system establishedbased on detection of the marker 188. The presentation data 164 may beutilized to display video content 193 for a time period duringpresentation of the multimedia message. For example, presentation of thevideo content 193 may be synchronized with the AR content 162.

After detection of the marker 188, mobile device 150 may be configuredto track one or more characteristics of the marker 188 to determine achange in position (e.g., distance, rotation, translation) of mobiledevice 150 with respect to changes in features of the marker 188 (e.g.,changes in size, angle, horizontal and/or vertical position within thedisplay). Mobile device 150 may modify/update placement data 163 basedon the determined change in position of the marker 188. In someimplementations, mobile device 150 may also generate a set of predictedpresentation data values and select one of the predicted set of valuesto be used for presentation of video content 193. The selected value(s)may be determined based on one or more inputs, such as motion data froma sensor (e.g., an inertial sensor) of mobile device 150.

In some implementations, processor 154 may access a second camera ofmobile device 150 to record a reaction of the recipient duringpresentation of the multimedia message. In such implementations,processor 154 may display a camera video stream corresponding to thesecond camera as described with reference to FIG. 10.

Based on presentation of the multimedia content, mobile device 150(e.g., processor 154) may send notification 198 that indicatespresentation of the multimedia content. For example, mobile device 150may send notification 198 to server 130 in response to initiation of themultimedia content, during the multimedia content, or in response to anend of the multimedia content. Based on notification 198, server 130 maynotify the sender/requester (via electronic device 110) that themultimedia content has been provided to recipient.

In some implementations, after presentation of the multimedia content,processor 154 may provide a prompt, via display, to send one or morerecordings, such as a recording of the multimedia content presented viadisplay 172, send a second recording (e.g., recipient's reaction)associated with a second camera, and/or to record and send a replymessage to sender. For example, processor 154 may provide a prompt asdescribed with reference to FIG. 10. In response to a request to sendthe one or more recordings, processor 154 may send mobile device content199 to server 130. Server 130 may store the one or more recordings whichmay be accessible to electronic device 110 via an application stored atmemory 116. Electronic device 110 may play the one or more recordings.An example of the one or more recordings played via electronic device110 is described with reference to FIG. 11.

One advantage provided by the system 100 is 3 that multimedia content(e.g., AR content 162 and/or video content 193) that corresponds to anobject, such as package 186, may be made accessible to and/or deliveredto the recipient. Mobile device 150 associated with the recipient isconfigured to implement a set rules (e.g., 160), such as an AR viewerapplication, that provided one or more conditions for establishing acoordinate system with respect to the package 186 and/or for dynamicallydetermining video content placement data (e.g., 193) based on thecoordinate system. To illustrate, the video content data for display maybe determined as a function of marker characteristics and a movementprediction algorithm. Based on the video content placement data (e.g.,163), the set of rules are further configured to determine and implementvideo content presentation characteristics (e.g., orientation,translation, size, scale, perspective, etc.) to dynamically adjust thevideo content 193 for presentation. Accordingly, the video content 193may be efficiently presented with a live video stream (e.g., 170) suchthat the video content 193 interacts with the AR content 162 included inthe live video stream. The displayed video content may further bepresented based on movement and placement of at least a portion of theAR content 162 such that occlusion and collision algorithm furthercoordinate and/or synchronize movement of the mobile device 150 withpresentation of the AR content 162 and the video content 193 within thelive video stream (e.g., 170). Thus, the present disclosureadvantageously provides multimedia content by establishing a coordinatesystem in a controlled manner such that the one or more rules may beefficiently applied to dynamically determine adjustments/updates topresentation data associated with the video content 193 and to selectthe placement data 163 based at least on features of marker 188 and/ormovement or predicted movement of mobile device 150.

Referring to FIG. 2, an example of an order form 210 is shown. Orderform 210 includes one or more categories 220, such categories 222-238,and one or more corresponding fields 240, such as fields 242-258. Fields240 may be populated via user input and may be configured to receivetext data, an indication of a file location, an input via a selectableoption of the field, etc.

The one or more categories 220 may include a sender 222, an item(s) 224,a recipient 226, a contact 228, an address 230, AR content 232, videocontent 254, message 236, and an access code 238. Sender field 242 maybe populated with a name, user name, account number, address, contactinformation, etc. associated with an individual or entity. For example,the individual or entity may be associated with populating and/orsubmitting order form 210. Item(s) field 244 may be populated with oneor more items to be delivered to an recipient, such as a user of mobiledevice 150. As illustrative, non-limiting examples, the one or moreitems may include a consumable good (e.g., cookies, fruit, a sandwich,alcohol, etc.), clothing (e.g., shoes, a shirt, a hat, etc.), apromotional item (e.g., a poster, a book, a pamphlet, etc.), and/oranother item. Recipient field 246 may be populated with a name, username, account number, etc., associated with an individual or entity toreceive the one or more items identified in item(s) field 244. Contactfield 248 may be populated with a phone number, email address, etc.associated with the recipient. Address field 250 may be populated with aphysical address, location description, directions, passcode, etc.associated with delivering the one or more items to the recipient.

AR content field 252 may be populated to indicate AR content is to beprovided in a multimedia message that is made available to and/orpresented to at least the recipient. In some implementations, AR contentfield 252 may include one or more selectable options of AR content(e.g., 162). To illustrate, a first option may correspond to a firstanimated character, a second option may correspond to a second animatedcharacter, and a third option may correspond to a holiday theme, asillustrative, non-limiting examples. Video content field 254 may bepopulated to include or identify video content (e.g., 193) to beincluded in the multimedia message. To illustrate, video content field254 may provide one or more options for the sender to record or attachvideo content (e.g., a video message). Message field 256 may bepopulated with text data, an image, or a combination thereof. Accesscode field 258 may be populated with security data, such as a passcode(e.g., password), security phase and/or security answer, etc. The accesscode field 258 may be populated with the security data to limit orrestrict access to the multimedia content. To illustrate, the securitydata may be known by the recipient, or may be provided to the recipient,and may be required to be provided in order for the recipient to receivea portion or an entirety of the multimedia message, such as the videocontent (e.g., 193) and/or the message (associated with message field256). For example, if the security data is not known by the recipient,the security data may be provided to the recipient, such as via textmessage, phone message, email, etc. In some implementations, thesecurity data may be provided to the recipient based on delivery of theone or more items (e.g., package 186). Referring to FIG. 1, server 130may be configured to communicate security data to mobile device 150 inresponse to receiving delivery confirmation 196. Additionally, oralternatively, access code field 258 may provide options to limit orrestrict a number of times the multimedia message can be viewed, whetherthe multimedia message is recordable, how long the multimedia message isavailable/accessible, etc.

Although order form 210 has been described as including particularfields (e.g., 242-258), such fields and descriptions are forillustration purposes and are not intended to be limiting. For example,order form 210 may include more fields or fewer fields than described.To illustrate, in some implementations, order form 210 further includesa delivery time field associated with a requested time of delivery(e.g., date, time, etc.) of the one or more items to the recipient.Additionally, or alternatively, one or more of fields 242-258 mayinclude multiple subfields.

Thus, FIG. 2 illustrates an example of an order form 210 to enable ablea sender to initiate a multimedia message to be made available to areceiver of one or more items (e.g., package 186). For example, orderform 210 is configured to enable a sender (e.g., a requester) to providevideo content (e.g., 193) to be incorporated into the multimedia messageand displayed in relation to and/or with AR content. Additionally, orderform 210 beneficially enables a security feature to be provided with themultimedia message to restrict or limit access to and/or disseminationof the multimedia message.

Referring to FIG. 3, an example of order data 140 is shown. Order data140 may be generated by, stored at, and/or maintained by one or moreservers, such as server 130. Order data 140 includes one or moreentries, such as entry 142. Entry 142 includes an one or more fields.The one or more fields my include an order number 310, an item(s) ID312, sender information 314, recipient information 316, an AR content ID318, a video content ID 320, a message ID 322, and an identifier field324 (corresponding to identifier 187). Item(s) ID 312 may include orcorrespond to the one or more items identified and/or described withreference to item(s) field 244. Sender information 314 may include orcorrespond to information included in sender field 242. Recipientinformation 316 may include or correspond to information included inrecipient field 246, contact field 248, and/or address field 250.

AR content ID 318 may include AR content (e.g., 162), an AR contentidentifier (of a plurality of AR content identifiers) and/or anindication of a storage location of AR content. For example, a first ARcontent identifier may correspond to a first animated character, asecond AR content option may correspond to a second animated character,a third AR content identifier may correspond to a birthday theme, and afourth AR content identifier may correspond to a get well theme, asillustrative, non-limiting examples. Video content ID 320 may includevideo data (e.g., video content 193) or an indication of a storagelocation of the video data. For example, the video data may include orcorrespond to data included in video content field 254. Message ID 322may include message data or an indication of a storage location of themessage data. For example, the message data may include or correspond todata included in message field 256.

Although entry 142 is described as including each of the fields 310-324,in other implementations, entry 142 may include fewer fields or morefields. To illustrate, in a particular implementation, entry 142 may notinclude AR content ID 318 and/or may include an access code fieldassociated with access code field 258. Additionally, or alternatively,one or more of fields 310-324 may include multiple subfields.

Thus, FIG. 3 illustrates an example of order data 140 that is associatedwith delivery of a package (e.g., 186) and a corresponding multimediamessage. For example, order data 140 may enable a server to provideorder request 195 to distribution entity 180 and to provide AR content162 and/or video content 193 to mobile device 150. Additionally, in someimplementations, order data 140 (e.g., entry 142) enables server 130 toprovide information, such as delivery confirmation 196 and/or mobiledevice content 199 to electronic device 110 associated with the sender.

Referring to FIG. 4, an example of a delivery 400 is shown. Delivery 400includes package 186 and, optionally, a card 410 (e.g., an insert).Package 186, card 410, or both may include identifier 187, such as abarcode, a QR code, text, or a combination thereof, as illustrative,non-limiting examples. As shown, card 410 includes a text portion 412.Text portion 412 may include instructions directing the recipient ofpackage 186 on how to receive (e.g., access) the multimedia content. Forexample, text portion 412 may direct the recipient to download and/oraccess application 160. Using application 160, recipient may scan (usingcamera 168) identifier 187. Additionally, or alternatively, text portion412 may provide instructions for the recipient to access preview content(e.g., multimedia message preview 194) via server 130. For example, insituations where the recipient does not have access to a mobile deviceand/or does not have the ability to access application 160 or a camera(e.g., 168), the text portion 412 may provide instructions for therecipient to access, such as via a website, multimedia message preview194. Thus, FIG. 4 provides an illustrative example of delivery 400 thatincludes marker 188 and/or identifier 187 to a recipient to enablepresentation of multimedia content as described herein.

Referring to FIGS. 5-10, examples of displayed frames of multimediacontent associated with delivery of a package (e.g., 168) are shown. Forexample, one or more of the frames may include or correspond to at leasta portion of a camera video stream (e.g., 170) into which AR content(e.g., 162) and video content (e.g., 193) is added. To illustrate, thecamera video stream may include or correspond to one or more images 170,and the one or more frames may be displayed via a display, such asdisplay 172, of a device. The device may include electronic device 110or mobile device 150, as illustrative, non-limiting examples. Toillustrate, one or more frames of FIGS. 5-10 may be generated by anapplication, such as application 160.

As described with reference to FIGS. 5-10, an application (e.g., 160)may be configured to access and/or operate one or more cameras, processone or more images, and/or perform one or more image processingoperations, such as object detection, object recognition, objecttracking (using a marker or marker-less), or a combination thereof, asillustrative, non-limiting examples. Additionally, as described herein,the camera video stream may be presented in real-time or near real-timesuch that a user viewing display 172 does not perceive a noticeabledelay between a change in position and/or orientation of a camera andpresentation of the camera video stream (produced based on a field ofview of the camera). In some implementations, a delay in presentation ofthe camera video stream may be noticeable and may still be considerednear real-time. To illustrate, such delays may be based on a processingcapability and/or image rendering capability of a device (e.g., 110,150) that includes the camera. It is noted that one or more frames ofand/or one or more operations described with reference to one of themethods of FIGS. 5-10 may be combined with one or more frames of and/orone or more operations of another of FIGS. 5-10. For example, one ormore frames of FIG. 4 may be combined with one or more frame of FIG. 6.As another example, one or more frames of FIGS. 5-6 may be combined withthe frame of FIG. 8. As another example, one or more frames of FIGS.9A-9C may be combined with the frame of FIG. 7. As another example, oneor more frames of FIG. 5-6 or 9A-9C may be combined with one or moreframes of FIG. 10.

Referring to FIG. 5, an example of a series of frames 500 presented viadisplay 172 is shown. A first frame 510 of the series 500 displays atarget 512. In some implementations, target 512 may be presented basedon accessing application 160, detecting identifier 187, communicatingidentifier data 197 to server 130, receiving video content 193, or acombination thereof. Target 512 may be configured to aid a user inaligning a marker (e.g., 188) within a field of view of a camera. Insome implementations, target 512 may include a bracket, line, and/orborder to frame (e.g., outline) the marker, a transparent representationof the marker, or a combination thereof, as illustrative, non-limitingexamples.

A second frame 520 of series 500 includes target 512 positioned overmarker 188 of package 186. For example, package 186 may be included in acamera video stream (e.g., 170) presented via display 172. Application160 may perform objection recognition/detection on second frame 520 toidentify marker 188. Based on detecting marker 188, the application maydetermine a position of marker 188, establish a coordinate system basedon marker 188, identify one or more edges of box (e.g., 186), performobject tracking on marker 188 and/or package 186, or a combinationthereof. Additionally, or alternatively, in response to detection ofmarker 188, application 160 may remove target 512 from display 172and/or may initiate presentation of the multimedia message including ARcontent 162 and video content 193.

A third frame 530 of series 500 includes AR content 162, such as a 3Danimated character, within third frame 530. The character is displayedat a first position within the camera video stream (e.g., 170) thatincludes package 186. To illustrate, between second frame 520 and thirdframe 530, the animated character may move to the first position onpackage 186. As illustrative, non-limiting examples, the animatedcharacter may have appeared out of thin air, dropped down onto package186, parachuted onto package 186, or climbed onto package 186. A fourthframe 540 of series 500 shows the character (e.g., 162) at a secondposition within the camera video stream. For example, between thirdframe 530 and fourth frame 540, the character may have walked from thefirst position towards the second position and tripped over marker 188.In other implementations, the character may tripped over anotherobjected included in the camera video stream, such as a ribbon (notshown) that is coupled to or incorporated into package 186.

A fifth frame 550 of series 500 includes the animated character at athird position within the camera video stream and additional AR content162, such as a monitor (e.g., a television), at a fourth position withinthe camera video stream. In fifth frame 550, animated character includesa remote control in one hand. To illustrate, between fourth frame 540and fifth frame 550, the animated character may have produced the remotecontrol and operated the remote control to cause the monitor to beincluded (e.g., drop down onto or raise up from package 186) in thecamera video stream. The monitor may have a screen 552 that isassociated with or corresponds to video content 193 to be displayed. Insome implementations, a boundary/perimeter of screen 552 may include orcorrespond to the placement data 163.

A sixth frame 560 of series 500 includes the AR content 162 (e.g.,animated character and monitor) included within the camera video stream.Sixth frame 560 also includes video content 193 within camera videostream and positioned based on AR content 162. For example, videocontent 193 is positioned within the monitor such that video content 193is presented via screen 552 of the monitor. To further illustrate,between fifth frame 550 and sixth frame 560, the animated character mayhave operated the remote control to cause video content 193 to bepresented via screen 552 of the monitor.

Thus, FIG. 5 illustrates aspects of initiation and presentation of themultimedia message via display 172. The multimedia message may presentthe AR content 162 in the camera video stream. Additionally, themultimedia message may present the video content 193 in relation to theAR content.

Referring to FIG. 6, an example of a series of frames 600 presented viadisplay 172 is shown. A first frame 610 of the series 600 is associatedwith a camera video stream (e.g., 170) and includes card 410 havingidentifier 187. Based on first frame 610, application 160 may detectidentifier 187 and send identifier data 197 to server 130. In otherimplementations, identifier 187 may be coupled to package 186 and firstframe 610 may include identifier 187 coupled to package 186. Responsiveto sending identifier data 197 to server 130, mobile device 150 mayreceive AR content 162, video content 193, and/or other content (e.g.,text data and/or image data) from server 130.

A second frame 620 of the series 600 includes package 186 includingmarker 188. Prior to second frame 620, application 160 may have detectedand identified marker 188. For example, first frame 510 and second frame520 of series 500 of FIG. 5 may have occurred between first frame 610and second frame 610 of series 600.

A third frame 630 of series 600 includes AR content 162, such as aladder, within third frame 630. To illustrate, between second frame 620and third frame 630, the ladder may have propped against a side ofpackage 186. A fourth frame 640 of series 600 shows AR content 162including the ladder and the animated character. To illustrate, betweenthird frame 630 and fourth frame 640, the animated character may haveclimbed up a portion of the ladder towards a top surface of package 186.A fifth frame 650 of series 600 includes the animated character at afirst position on the top surface of package 186. To illustrate, betweenfourth frame 640 and fifth frame 650, the animated character may haveclimb off of the ladder onto the top surface of package 186 and moved tothe first position. A sixth frame 660 of series 600 includes the ARcontent 162, such as the ladder, the animated character, and themonitor. Sixth frame 660 also includes video content 193 positionedbased on AR content 162. For example, video content 193 is positionedwithin the monitor such that video content 193 is presented via a screenof the monitor. To further illustrate, between fifth frame 650 and sixthframe 660, the monitor may have been included in the camera video streamand animated character may have moved to a second position as shown insixth frame 660.

Thus, FIG. 6 illustrates aspects of initiation and presentation of themultimedia message via display 172. For example, FIG. 6 illustratesdetection of identifier 187 and presentation of AR content 162 in thecamera video stream. Additionally, FIG. 6 illustrates presentation ofthe video content 193 based on (e.g., within) the AR content 162.

Referring to FIG. 7, an example of a frame 700 included in a series offrames (associated with a multimedia message) presented via display 172is shown. As shown, frame 700 includes package 186 AR content 162, suchas an animated character and a monitor (e.g., a television). Videocontent 193 is positioned within the monitor such that video content 193is presented via a screen of the monitor. The AR content 162 alsoincludes a sign 702 (e.g., a card). Sign 702 includes one or moreportions, such as a first portion 710 including text content and asecond portion 712 including an image, such as a logo, picture, graphic,etc. The content included in first portion 710, second portion 712, orboth, may include or correspond to message field 256 and or message ID322. Sign 702 may be included in the camera video content prior to,during (e.g., a portion or an entirety), and/or after presentation ofvideo content 193. Thus, FIG. 6 illustrates aspects of presentation ofthe multimedia message via display 172.

Referring to FIG. 8, an example of a frame 800 included in a series offrames (associated with a multimedia message) presented via display 172is shown. As shown, frame 800 includes package 186 and AR content 162,such as an animated character and a sign 802 (e.g., a card). Sign 802includes one or more portions, such as a first portion 810, a secondportion 812, and a third portion 814. First portion 810 includes textcontent, second portion 812 includes an image, such as a logo, picture,graphic, etc., and third portion 814 includes video content 193. Thecontent included in first portion 810, second portion 812, or both, mayinclude or correspond to message field 256 and or message ID 322. Thus,FIG. 7 illustrates aspects of presentation of the multimedia message viadisplay 172.

Referring to FIGS. 9A-9C, examples of AR content 162 in which videocontent 193 is presented are shown. To illustrate, each of the examplesof FIGS. 9A-9C enable at least a portion video content 193 to be viewedover a range of camera positions and/or camera orientations. Forexample, each of FIGS. 9A-9C include a first frame associated with afirst camera pose (e.g., a first position and a first orientation ofcamera 168 with respect to package 186 (e.g., marker) and a second frameassociated with a second camera pose (e.g., a second position and asecond orientation of camera 168 with respect to package 186 (e.g.,marker 188). In some implementations, the first camera pose is associatewith a front view of package 186 and the second camera pose isassociated with a rear view of package 186. In each of the first frameand the second frame, a portion and/or version of video content 193 isvisible to a user such that movement/positioning of the camera by theuser is not limited in order to view the video content 193 of themultimedia message.

Referring to FIG. 9A, an example of a series of frames 900 (associatedwith camera video stream 170) presented via display 172 is shown. Afirst frame 910 of the series 900 includes a frame of camera videostream (e.g., 170) captured by camera (e.g., 168) at a first positionand first orientation with respect to package 186 (e.g., marker 188).For example, first frame 910 may correspond to a first camera poseassociated with camera 168. First frame 910 includes AR content 162,such as the animated character, a projector, and a projection screen. Asshown, a front view of video content 193 is presented on the projectionscreen that is flat. The video content may be positioned and/or sized inrelation to the AR content 162 (e.g., the projection screen) based onthe first camera pose, such as the first position and orientation ofcamera 168.

A second frame 920 of the series 900 includes another frame of cameravideo stream captured by camera 168 at a second position and a secondorientation with respect to package 186 (e.g., marker 188). For example,second frame 920 may correspond to a second camera pose associated withcamera 168. Second frame 920 includes AR content 162, such as theanimated character, the projector, and the projection screen. As shown,video content 193 is presented on the projection screen. As compared tofirst frame 910, video content 193 displayed in second frame 920 is areverse image (e.g., a rear view) of video content 193 displayed infirst frame 910.

Referring to FIG. 9B, an example of a series of frames 900 (associatedwith camera video stream 170) presented via display 172 is shown. Afirst frame 940 of the series 930 is associated with the first camerapose and a second frame 950 of the series 930 is associated with thesecond camera pose. Each of the first and second frames 940, 950includes AR content 162, such as the animated character, the projector,and the projection screen. As shown, the projection screen has a curvedsurface. In other implementations, the projection screen may havedifferent size, shape, and/or geometry. For example, the projectionscreen may be disc shaped (e.g., semi-spherical).

Referring to FIG. 9C, an example of a series of frames 960 (associatedwith camera video stream 170) presented via display 172 is shown. Afirst frame 970 of the series 960 is associated with the first camerapose and a second frame 980 of the series 960 is associated with thesecond camera pose. Each of the first and second frames 970, 980includes AR content 162, such as the animated character and athree-dimensional (3D) structure of multiple screens. For example, asshown in first frame 970, the multi-screen structure includes a frontscreen and a side screen. In some implementations, a top surface 972 ofthe multi-screen structure may include text content or an image (e.g., alogo). As shown in second frame 980, the multi-screen structure includesthe side screen and a rear screen. Each of the screens of themulti-screen structure may include video content 193. To illustrate,video content 193 presented via each screen of the multi-screenstructure may be synchronized in time.

Referring to FIG. 10, an example of a series of frames 1000 presentedvia display 172 is shown. A first frame 1010 of the series 1000 displaystarget 512 in a camera video stream corresponding to a first camera(e.g., 168). Target 512 may be configured to enable a user to align amarker (e.g., 188) within a field of view of the first camera. Firstframe 1010 also includes a user portion 1012 associated with a secondcamera video stream of a second camera. To illustrate, mobile device 150may include multiple camera, such as a front facing camera (e.g., firstcamera) and a rear facing camera (e.g., second camera). As shown, userportion 1012 includes a target (e.g., dashed line).

A second frame 1020 of series 1000 includes target 512 positioned overmarker 188 of package 186. For example, package 186 may be included in acamera video stream (e.g., 170) presented via display 172. Anapplication (e.g., 160) may perform objection recognition/detection onsecond frame 520 to identify marker 188. Based on detecting marker 188,the application may determine a position of marker 188, establish acoordinate system based on marker 188, identify one or more edges of box(e.g., 186), perform object tracking on marker 188 and/or package 186,or a combination thereof. Additionally, as shown, a face of the user isincluded user portion 1012. In some implementations, application 160 maydetect that an object (e.g., a face) is present in second camera videostream. Based on identification of marker 188 and/or detection of bothmarker 188 and the object (e.g., a face), application 160 may initiatepresentation of AR content (e.g., 162) and/or video content (e.g., 193)within first camera video stream (e.g., 170). In some implementations,based on identification of marker 188 and/or detection of both marker188 and the object (e.g., a face), application 160 may initiate a firstrecording corresponding to presentation of AR content (e.g., 162) and/orvideo content (e.g., 193) within first camera video stream (e.g., 170).Additionally, or alternatively, based on identification of marker 188and/or detection of both marker 188 and the object (e.g., a face),application 160 may initiate a second recording corresponding to secondcamera video stream.

A third frame 1030 of series 1000 includes AR content 162, such as a 3Danimated character at a first position, within third frame 1030. Toillustrate, between second frame 520 and third frame 530, target 512 andthe target of user portion 1012 have been removed, and the animatedcharacter may be presented on package 186. As compared to second frame1020, user portion 1012 has a reduced size to make more of the firstcamera video stream (and AR content) visible via display 172.

A fourth frame 1040 of series 1000 shows AR content 162 that includesanimated character (at a second position) and a monitor (e.g., atelevision) within the first camera video stream. In fourth frame 1040,animated character includes a remote control in one hand and videocontent 193 is presented and positioned based on AR content 162. Forexample, video content 193 is positioned within the monitor such thatvideo content 193 is presented via a screen of the monitor.

A fifth frame 1050 of series 1000 shows the animated character at athird position. To illustrate, between fourth frame 1040 and fifth frame1050, the animated character moved from the second position (e.g., alower left portion of display 172) to the third position (e.g., a lowerright portion of display 172). Based on the movement of the animatedcharacter between fourth frame 1040 and fifth frame 1050, application160 may have adjusted a characteristic of user portion 1012. Forexample, the characteristic of user portion 1012 may include a size, ashape, a position, a location, a transparency, another characteristic,or a combination thereof. As shown in fifth frame 1050, user portion1012 is positioned in the lower right of display 172 as compared tobeing displayed in the lower right of display 172 in fourth frame 1040.In some implementations, application 160 may adjust the characteristicof user portion 1012 in response to a determination that at least aportion of or an entirety of the character is within a threshold athreshold distance of user portion 1012.

A sixth frame 1060 of series 1000 includes the AR content 162 (e.g.,animated character and a sign 1064). Sixth frame 1060 may be presentedafter completion of the video content 193. In some implementations,sixth frame 1060 may be presented after application 160 stopped storingthe first recording and/or the second recording. The sign 1064 mayinclude a portion 1066 that includes a message for the user. Forexample, the message may indicate an option for the user to provide areply message to a sender of package 186. To illustrate, the replaymessage may include the first recording, the second recording, a textmessage (e.g., a static message or a dynamic/scrolling message), a videomessage recorded by the user (e.g., a pre-recorded or existing video),or a video recorded after presentation of the multimedia contentincluding the AR content 162 and the video content 193), an audio clip,or a combination thereof. In a particular implementation, application160 may control the second camera and display 172 to enable the user torecord a reply video message for the sender.

Thus, FIG. 10 illustrates aspects of presentation of the multimediamessage via display 172. For example, as described with reference toFIG. 10, first and/or second recordings may be generated in associationpresentation of the multimedia content. The first and/or secondrecordings may be available to the user (e.g., recipient) for replay ortransmission/posting for another user (i.e., sender). In someimplementations, an option to record an additional message and/or videocontent may be presented to the user (e.g., recipient).

Referring to FIG. 11, an example of a series of frames 1100 presentedvia a display 1112 is shown. Display 1112 may include or correspond to adisplay of a device, such as electronic device 110 or mobile device 150.The series of frames 1100 may include or correspond to playback ofrecorded content, such as content recorded at the same device or adifferent device. For example, the recorded content ma include orcorrespond to mobile device content 199.

A first frame 1110 of the series 1100 includes a first portion 1114 anda second portion 1116. First portion 1114 may include or correspond to afirst recording, such as a recording of multimedia content presented atmobile device 150. Second portion 1116 may include or correspond to asecond recording, such as recording of a user of mobile device 150during presentation of the multimedia content at mobile device 150. Forexample, the second recording may include or correspond to contentdisplayed via user portion 1012. As shown, first frame 1110 shows firstscenes of each of the first recording (presented in first portion) andsecond recording (presented in second portion). In some implementations,presentation of the first and second recordings via display 1112 may betime synchronized.

A second frame 1120 of series 1100 shows second scenes of each of thefirst recording (presented in first portion) and second recording(presented in second portion). For example, as shown, second frame 1120shows the animated character (in first portion 1114) after the animatedcharacter tripped, and shows a reaction of the user (in second portion1116) responsive to observing that the animated character tripping. Athird frame 1130 of series 1100 shows third scenes of each of the firstrecording (presented in first portion) and second recording (presentedin second portion). For example, as shown, third frame 1130 shows theanimated character and the monitor including video content (in firstportion 1114), and shows the user (in second portion 1116). A fourthframe 1140 of series 1100 shows fourth scenes of each of the firstrecording (presented in first portion) and second recording (presentedin second portion). In some implementations, the fourth scenes may beassociated with an end of the first and second recordings.

A fifth frame 1150 of series 1100 shows a recorded video message fromthe user (e.g., the receiver) to the sender. For example, the messagemay have been recorded after the user viewed the multimedia content.Although FIG. 11 has been described as presenting three differentrecordings, in other implementations, fewer than three or more thanthree recordings may be presented.

Thus, FIG. 11 illustrates describes playback of recorded contentassociated with the multimedia message. To illustrate, a first recordingpresented via first portion 1114 includes the multimedia message aspresented to the recipient and second recording presented via secondportion 1116 include the recipient's demeanor/reaction duringpresentation of the multimedia message. The third recoding presentedafter the first and second recordings includes a message from therecipient to the sender.

Referring to FIG. 12, a method 1200 of operating an electronic device isshown. For example, method 1200 may be performed by electronic device110, mobile device 150, or electronic terminal 182.

Method 1200 may include initiating, at the electronic device, an orderrequest via a server, at 1502. For example, the order request mayinclude or correspond to order form 210. The server may include orcorrespond to server 130.

Method 1200 includes generating order information by the electronicdevice, at 1204. For example, the order information may include orcorrespond to order information 192, input(s) provided to one or morefields 242-258, or a combination thereof. To illustrate, generating(e.g., 1204) the order information may include selecting an item, at1206, providing sender information and recipient information, at 1208,and requesting a multimedia message, at 1210. Requesting (e.g., 1210)the multimedia content may include selecting augmented reality content,at 1212, providing video content, at 1214, providing a text message, at1216, providing an image, at 1218, or a combination thereof. Forexample, the augmented reality content and the video content may includeor correspond to AR content 162 and video content 193, respectively.

Method 1200 may include receiving, at the electronic device, amultimedia message preview from the server, at 1220. The multimediamessage preview may include or correspond to preview content 139. Method1200 includes submitting, by the electronic device, the order request tothe server, at 1222. The order request may include or correspond toorder information 192 and/or order form 210.

Method 1200 may include receiving, at the electronic device, a deliveryconfirmation, at 1224. The delivery confirmation, such as deliveryconfirmation 196, may correspond to delivery of a package that includesat least one item identified in the order request. For example, thepackage may include or correspond to package 186 delivered bydistribution entity 180.

Method 1200 may include receiving, at the electronic device, mobiledevice content associated with the multimedia message, at 1226. Forexample, the mobile device content may include or correspond to mobiledevice content 199 and/or series of frames 1100. Method 1200 may includepresenting the mobile device content via a display device of theelectronic device, at 1228. Thus, method 1200 may enable operation of anelectronic device (e.g., 110, 150) to order delivery of an item to arecipient and to be notified of delivery of multimedia contentassociated with the delivery.

Referring to FIG. 13, a method 1300 of operating a server is shown. Forexample, method 1300 may be performed by server 130. Method 1300 mayinclude receiving, by the server from an electronic device, an orderrequest for an item, at 1302. For example, the order request may includeor correspond to the order information 192 or order form 210. Theelectronic device may include or correspond to electronic device 110,mobile device 150, or electronic terminal 182. The order request may beassociated with video content, such as video content 193.

Method 1300 may include initiating storage of the video content by theserver, at 1304. To illustrate, the server may initiate storage of thevideo content at a memory, such as memory 136, that is accessible to theserver. In some implementations, the server may receive the videocontent from a device, such the electronic device that that initiatedthe order request. In other implementations, the server may receive thevideo content from a manufacturer, provider, supplier, and/ordistributor of the item, a delivery service or shipper of a package thatincludes the item, or another device or entity.

Method 1300 may include generating an order entry by the server, at1306. For example, the order entry may include or correspond to entry142. Generating (e.g., 1306) the order entry may include generating anorder number, at 1308, generating an identifier corresponding to theorder number, at 1310, or both. The order number may include orcorrespond to order number 310. The identifier may include or correspondto identifier 187, marker 188, or a combination thereof.

Method 1300 may include providing, by the server, an order request to adistribution entity, at 1312. For example, the order request may includeor correspond to order request 195, and the distribution entity mayinclude or correspond to distribution entity 180. Method 1300 mayinclude receiving, by the server, confirmation of delivery of a packagecorrespond to the order request, at 1314. For example, the confirmationmay include or correspond to delivery confirmation 196. In someimplementations, the server may receive the confirmation fromdistribution entity 180 and/or may send the confirmation to a device,such as a device that initiated the order request.

Method 1300 may include receiving, by the server, identifier data from amobile device, at 1316. For example, the identifier data may include orcorrespond to identifier data 197, and the mobile device may include orcorrespond to mobile device 150. The identifier data may include orcorrespond to identifier 187. Method 1300 includes identifying, by theserver, the order entry based on the identifier data, at 1318. Toillustrate, the server may identify and/or access entry 142 based onidentifier data. Method 1300 further includes initiating, by the server,transmission of the video content to the mobile device, at 1320.

Method 1300 may also include receiving, at the server from the mobiledevice, a notification of presentation of a multimedia message, at 1322.For example, the notification may include or correspond to notification198. The multimedia message may be associated with the order request andmay include the video content and augmented reality content, such as 3Daugmented reality content. To illustrate, multimedia message may includeor correspond to mobile device content 199. In some implementations, thenotification includes mobile device content 199. In suchimplementations, the server may provide the notification and/or themobile device content 199 to a device, such as a device that initiatedthe order request. Thus, method 1300 describes operation of server(e.g., 130) to enable delivery of an ordered item to a recipient,delivery of multimedia content to the recipient, and notification ofdelivery of the multimedia content.

Referring to FIG. 14, a method 1400 of operating a server is shown. Forexample, method 1400 may be performed by electronic device 110, mobiledevice 150, or electronic terminal 182.

Method 1400 includes receiving, at a mobile device from a server, videocontent corresponding to an identifier, at 1402. For example, the servermay include or correspond to server 130, and the video content mayinclude the video content 193. The identifier may be associated with apackage. To illustrate, the identifier may include or correspond toidentifier 187 associated with package 186.

Method 1400 include receiving, at the mobile device, a plurality ofimages including at least a portion of the package, at 1404. Theplurality of images may correspond to a camera video stream. Forexample, the plurality of images may include or correspond to the one ormore images 170.

Method 1400 includes generating, at the mobile device, multimediacontent associated with the package, 1406. Generating (e.g., 1406) mayinclude displaying the camera video stream by the mobile device, at1408. Generating (e.g., 1406) may also include displaying, by the mobiledevice, augmented reality content within at least a portion of thedisplayed camera video stream, at 1410, and displaying, by the mobiledevice, the video content in relation to the augmented reality content,at 1412. The augmented reality may include or correspond to AR content162.

In some implementations, the multimedia content associated with thepackage may be generated at a different device, such as at server 103.In such implementations, the sever may transmit (e.g., stream) themultimedia content to the mobile device for presentation via a display.

Thus, method 1400 describes operation of a device (e.g., 110, 150) toenable delivery of a multimedia message that corresponds to delivery ofa package (e.g., an item). The multimedia message may adventurouslydisplay AR content and video content in a live video stream generated bya camera of the device.

The operations described with reference to the methods of FIGS. 12-14may be controlled by one or more a processing unit such as a centralprocessing units (CPUs), controllers, field-programmable gate array(FPGA) devices, application-specific integrated circuits (ASICs), otherhardware devices, firmware devices, or any combination thereof. It isnoted that one or more operations described with reference to one of themethods of FIGS. 12-14 may be combined with one or more operations ofanother of FIGS. 12-14. For example, one or more operations of method1200 may be combined with one or more operations of method 1300. Asanother example, one or more operations of method 1200 may be combinedwith one or more operations of method 1400.

Although one or more of the disclosed figures may illustrate systems,apparatuses, methods, or a combination thereof, according to theteachings of the disclosure, the disclosure is not limited to theseillustrated systems, apparatuses, methods, or a combination thereof. Oneor more functions or components of any of the disclosed figures asillustrated or described herein may be combined with one or more otherportions of another function or component of the disclosed figures.Accordingly, no single implementation described herein should beconstrued as limiting and implementations of the disclosure may besuitably combined without departing from the teachings of thedisclosure.

Although the present disclosure and its advantages have been describedin detail, it should be understood that various changes, substitutionsand alterations can be made herein without departing from the spirit andscope of the disclosure as defined by the appended claims. Moreover, thescope of the present application is not intended to be limited to theparticular embodiments of the process, machine, manufacture, andcomposition of matter, means, methods and steps described in thespecification. As one of ordinary skill in the art will readilyappreciate from the disclosure, processes, machines, manufacture,compositions of matter, means, methods, or steps, presently existing orlater to be developed that perform substantially the same function orachieve substantially the same result as the corresponding embodimentsdescribed herein can be utilized according to the present examples.Accordingly, the appended claims are intended to include within theirscope such processes, machines, manufacture, compositions of matter,means, methods, or steps.

1-24. (canceled)
 25. A method comprising: receiving, at a processor of amobile device, a plurality of images from a camera, at least one imageof the plurality of images including an object; displaying a cameravideo stream based on the plurality of images; displaying threedimensional (3D) augmented reality content in the camera video stream;and displaying video content on at least a portion of the 3D augmentedreality content in the camera video stream, the video content associatedwith the object.
 26. The method of claim 25, wherein: displaying 3Daugmented reality content in the camera video stream comprisesdisplaying a first 3D augmented reality object; and the video content isdisplayed as overlaying at least a portion of the first 3D augmentedreality object.
 27. The method of claim 25, wherein: at least one imageof the plurality of images including an identifier associated with theobject; and the video content is received at the mobile device from aserver, the video content corresponding to the identifier.
 28. Themethod of claim 27, wherein the video content comprises personalizedvideo data submitted to the server by a third party.
 29. The method ofclaim 25, further comprising: receiving, by the processor, placementdata associated with the 3D augmented reality content; and displayingthe video content based on the placement data.
 30. The method of claim29, wherein the placement data defines a boundary associated withpresentation of the video content, and wherein the video content isdisplayed within the boundary.
 31. The method of claim 25, furthercomprising sending, from the mobile device to a server, a notificationassociated with a completion of display of the 3D augmented realitycontent, the video content, or both, at the mobile device.
 32. Themethod of claim 25, further comprising: establishing communication witha server; initiating, via the server, an order for delivery of an itemto a recipient; and communicating order request information, generatedat the mobile device, to the server to initiate an order for delivery ofan item to a recipient.
 33. The method of claim 25, further comprising:detecting, by the mobile device, an identifier included in a first imageof the plurality of images, the identifier associated with the object;extracting, by the mobile device, identifier data from the identifier inthe first image; and transmitting, by the mobile device, the identifierdata to a server.
 34. A device comprising: a processor; and a memorystoring one or more instructions that, when executed by the processor,cause the processor to: receive a plurality of images from a camera, atleast one image of the plurality of images including an object; initiatedisplay of a camera video stream based on the plurality of images;initiate display of three dimensional (3D) augmented reality content inthe camera video stream; and initiate display of video content on atleast a portion of the 3D augmented reality content in the camera videostream, the video content associated with the object.
 35. The device ofclaim 34, wherein: the at least one image of the plurality of imagesincludes an identifier associated with the object; and the one or moreinstructions, when executed by the processor, further cause theprocessor to receive the video content from a server, the video contentcorresponding to the identifier.
 36. The device of claim 34, furthercomprising: a display coupled to the processor, the display configuredto display the camera video stream, the 3D augmented reality content,and the video content; and wherein the video content comprisespersonalized video data submitted to a server by a third party.
 37. Thedevice of claim 34, wherein the one or more instructions, when executedby the processor, further cause the processor to: receive placement dataassociated with the 3D augmented reality content; and initiate displayof the video content based on the placement data.
 38. The device ofclaim 37, wherein: the placement data defines a boundary associated withpresentation of the video content; and the video content is displayedwithin the boundary.
 39. The device of claim 34, wherein: to displaying3D augmented reality content in the camera video stream the one or moreinstructions, when executed by the processor, further cause theprocessor to initiate display of a first 3D augmented reality object;and the video content is displayed as overlying at least a portion ofthe first 3D augmented reality object.
 40. The device of claim 34,further comprising: a display coupled to the processor; or the cameracoupled to the processor; or a combination thereof.
 41. The device ofclaim 34, wherein the one or more instructions are included in anapplication that is stored at the memory.
 42. The device of claim 34,wherein the one or more instructions, when executed by the processor,further cause the processor to: receive text data, image data, or bothfrom a server based on an identifier included in the at least one imageof the plurality of images, the identifier associated with the object;initiate display of the text data, the image data, or both in the cameravideo stream; and arrange the text data, the image data, or both basedon the 3D augmented reality content.
 43. The device of claim 34, whereinthe memory is further configured to store the 3D augmented realitycontent, the video content, or a combination thereof, and wherein theone or more instructions, when executed by the processor, further causethe processor to initiate storage, at the memory, of multimedia contentpresented via the display, the multimedia content associated with thecamera video stream, the 3D augmented reality content, the videocontent, or a combination thereof.
 44. A computer-readable storagemedium storing instructions that, when executed by one or moreprocessors, cause the one or more processors to perform operationscomprising: receiving, at a mobile device, a plurality of images from acamera, at least one image of the plurality of images including anobject; initiating display of a camera video stream based on theplurality of images; initiating display of three dimensional (3D)augmented reality content in the camera video stream; and initiatingdisplay of video content on at least a portion of the 3D augmentedreality content in the camera video stream, the video content associatedwith the object.